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ABSTRACi 

Hospitals — the most costly segment of the health care 
system — are beginning to use benchmarking to discover how other 
hospitals and businesses have developed cost-cutting and time-saving 
ways of doing things. Benchmarking is a sophisticated, multifaceted 
procedure, usually conducted by teams, for identifying and adapting 
best-in-class practices. Benchmarking involves the following steps: 
defining one's own key processes and understanding how they work, 
selecting the processes most suited to benchmarking, developing 
measures of quality, identifying the best organizations with which to 
benchmark, and implementing the best of the best by modifying 
processes and testing the results. Groups of hospitals have used 
benchmarking to improve several areas: the quality of administrative 
and financial services, the quality of records management, the 
quality of admissions and related processes, the quality of emergency 
services, and health care itself. Educators can look at health care 
benchmarking practices and adapt the process to their own needs in 
their schools and school systems. (YLB) 
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HEALTHCARE: A LESSON 
IN BENCHMARKING FOR 
EDUCATORS 

Benchmarking, a relatively new tool 
developed by manufacturing companies 
to achieve dramatic and continuous im- 
provement in the way they do things, is 
available to achieve quality improve- 
ments in healthcare and education. Hos- 
pitals — the most costly segment of the 
healthcare system — are, in fact, begin- 
ning to use benchmarking to discover 
how other hospitals and other busi- 
nesses have developed cost-cutting and 
time-saving ways of doing things. The 
purpose of this Brief is to show how a 
field comparable to education is using 
benchmarking. 

For leaders in healthcare, the most 
powerful pro-benchmarking force is in- 
tangible: the professional commitment of 
clinicians and healthcare workers to 
share knowledge that can benefit pa- 
tients. Similarly, educational leaders will 
find that their commitment to students, 
their networks of professional affiliations, 
and their analytic skills can help them tai- 
lor the valuable technique of benchmark- 
ing to the needs of schools and school 
systems. Further, as healthcare organi- 
zations have discovered that benchmark- 
ing can improve the quality of clinical 
care as well as administrative proc- 
esses, schools will discover that bench- 
marking is a tool that can improve teach- 
ing and learning. 

In organizations as varied as Xerox, 
AT&T, Eli Lilly, and Southwest Airlines, 
managers seeking a surge in quality 
have used benchmarking to make dra- 
matic improvements in controlling their 
costs and speeding up and improving 
their service. They have located other or- 
ganizations with superior performance in 
specific areas, learned what the others 
did to excel, and instituted similar — or 
better — improvements. 

The potential rewards from bench- 
marking are high because the gaps in 
performance between the best compa- 
nies and others can be vast: manufactur- 
ing-industry leaders generate new prod- 
ucts up to two and a half times faster 
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than the industry average, and at half 
the cost. The director of quality at Mo- 
torola, which has been employing bench- 
marking for several years, goes even fur- 
ther: "Best-in-class companies," he says, 
"have error rates 500 to 1 ,000 times 
lower than average" (First find your 
bench, 1991). 

Benchmarking is not just a new name 
for networking or comparative data 
analysis. It is a sophisticated tool, a multi- 
faceted procedure, usually conducted by 
teams, for identifying and adapting best- 
in-class practices. Benchmarking in- 
volves adapting and implementing "the 
best of the best," wherever that best is. It 
definitely need not be in one's own indus- 
try or type of service. Indeed, often the 
most useful comparisons come from out- 
side one's own industry or technology; 
one's own field is so familiar that it is 
sometimes difficult to see it with a fresh 
perspective. 'The purpose of benchmark- 
ing is to expose managers to new ways 
of doing things in order to spark creativ- 
ity, not to create efficient copy cats" 
(Walleck, 1991, p. 4.). In fact, bench- 
marking does not necessarily provide a 
best system to copy and adopt. Instead, 
it reveals and suggests an amalgam of 
different approaches and ideas to im- 
prove a process. A benchmarking part- 
ner is never going to have the exact 
same problem or resources. You look at 
their system, see what works and why it 
works, and apply pieces of it to your own 
situation. The creativity and openness 
fostered by benchmarking frequently 
yield ioeas and approaches that were 
not even being done by the benchmark- 
ing partner. 

Benchmarking Involves: 

• Defining your own key processes and 
understanding how they work 

• Selecting the processes most suited 
to benchmarking, such as those that 
are most important to your customers 
or those with chronic problems that in- 
ternal improvement teams have tried 
but failed to fix 

• Developing measures of quality, met- 
rics that allow you to compare your 
processes and results with others 
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• Identifying the best organizations to 
benchmark with 

• Implementing the best of the best by 
modifying your processes a^ testing 
the results 

The Uses of Benchmarking in 
Healthcare 

Perhaps more than in the industrial 
world, healthcare organizations and edu- 
cational institutions can tap into a lode of 
benchmarking partners, organizations 
that are similar but not really competi- 
tors. Indeed, healthcare systems and alli- 
ances, whose members are not competi- 
tors, are conducting group benchmark- 
ing: reaching consensus on project se- 
lection and developing common meas- 
ures and workable benchmarking strate- 
gies. For example, the 18-member Vol- 
untary Hospitals of America (VHA) Tri- 
State Region are using their organiza- 
tion to share information and ideas and 
the wisdom of the 860 hospitals in the 
national system. Members are required 
to participate in two of VHA's national da- 
tabase projects and in regional data 
sharing. This foundation of information- 
sharing led them to develop a compre- 
hensive system for conducting bench- 
marking studies. 

Even competing hospitals are finding 
group benchmarking useful. For exam- 
ple, in San Diego, 20 civilian and military 
hospitals formed a consortium, the 
Southern California Coalition for Improv- 
ing Healthcare Quality, that meets once 
a month to conduct educational ses- 
sions and share information about qual- 
ity initiatives at their hospitals. 

In the following examples illustrating 
the variety of ways that groups of hospi- 
tals have employed benchmarking, edu- 
cators will recognize processes and situ- 
ations that are comparable to the world 
of education. 

Improving the Quality of Administra- 
tive and Financial Services. Twenty Wis- 
consin hospitals in the Rural Wisconsin 
Hospital Cooperative, a cooperative 
owned by 19 rural hospitals and one ur- 
ban hospital, are conducting a joint effort 
to solve administrative and clinical prob- 
lems. Benchmarking was their first step, 



and the goal of the benchmarking effort 
was to improve the quality of the hospi- 
tals' administrative and financial services. 

The benchmarking team took six 
steps: 

• Representatives of the same depart- 
ment from different hospitals formed 
a team 

• Each team chose an administrative or 
financial function that could be im- 
proved 

• Each team member analyzed the spe- 
cific function at his or her own hospital 

• Each team member compared his 
hospital's performance with the other 
hospitals on the team 

• Each team compared its collective 
performance with that of comparable 
external organizations, including but 
not limited to, other hospitals 

• Team members then adapted and im- 
plemented the best observed prac- 
tices in their own institutions 

Six hospitals formed a dietary depart- 
ment team; three formed a respiratory 
department team; three formed a physi- 
cal therapy department team; and five 
formed a business office team. 

The business office team is attempt- 
ing to improve the cash flow at its hospi- 
tals. The time lag between patient dis- 
charge and payment was averaging 56 
days. As a result of benchmarking, the 
team decided to start patient paperwork 
earlier through pre-admission programs. 

A hospital acting on its own, 300-bed 
Cleveland Memorial Hospital in Shelby, 
NC, has used benchmarking to improve 
its administrative processes and has al- 
ready documented measurable improve- 
ments. B 'ore the benchmarking project, 
the insurance verification clerk and the fi- 
nancial counselor at the hospital each 
had to work an average of two hours ex- 
tra on Mondays to catch up on the paper- 
work (on patient admissions) that had 
piled up on the weekend, verifying insur- 
ance information by phone, one patient 
at atir .e. Through benchmarking, they 
learned that most records could be 
grouped into batches according to payer, 
and verified by using computer terminals 
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in the hospital that were linked to com- 
puters for the three major payers — Blue 
Cross/Blue Shield, Medicare, and Medi- 
caid. Since these three constituted 
roughly 60 percent of their business, 
large volumes could be dealt with faster, 
leaving clerks more time to deal with the 
commercial carriers that had to be dealt 
with individually by phone. They thus 
eliminated 200 overtime hours logged by 
the two clerks each year. 

In addition, Cleveland Memorial has 
made a variety of improvements in its 
check-in process for preoperative testing 
patients. For example, they have dedi- 
cated a clerk to check in these patients 
so that they do not have to wait with 
other inpatients and outpatients; in- 
stalled a fax machine so that physicians 
can send test orders from their offices in 
advance rather than having patients 
bring them in on the day of admission; 
and streamlined the system for ordering 
tests, entering them into the system the 
day before the patient arrives for testing. 
As a result of these changes, patients 
coming to the hospital for preoperative 
testing spend an average of 23 minutes 
less at the hospital, and the staff have re- 
claimed their lunch hour, which they had 
often sacrificed to the chaos of the ad- 
missions process. Another benefit, not 
measured in minutes or hours, is that 
hospital staff who have had time for 
lunch are probably more pleasant to- 
ward the patients. Thus, the customer 
service improves in more than one di- 
mension. 

Improving the Quality of Records Man- 
agement. The Catholic Healthcare West 
(CHW) system, which includes San Di- 
ego Mercy and 1 3 other hospitals in Cali- 
fornia, Nevada, and Arizona, targeted 
two critical processes: medication deliv- 
ery, and the entire system of medical re- 
cords management, including the proc- 
esses of moving, firing, preparing, and re- 
trieving records. 

Once the group agreed on these two 
processes, they had to go beyond their 
traditional ways of measuring things. 
The first big barrier to overcome was 
that they were not all measuring proc- 
esses in the same way. With 14 very dif- 
ferent hospitals, in terms of size and 



structure, the development of a consis- 
tent set of metrics also proved a knotty 
undertaking. For the medical records pro- 
ject, they decided to collect data on, 
among other things, the number of full- 
time equivalencies who work on medical 
records, their functions, how many em- 
ployees serve across functions, and the 
time it takes to turn around a record. 

Improving the Quality of Admissions 
and Related Processes. The largest 
group benchmarking effort now under- 
way in the healthcare field is a national 
effort coordinated by the Healthcare Fo- 
rum and the American Productivity and 
Quality Center's International Bench- 
marking Clearinghouse (IBC). A group of 
32 hospitals in the Healthcare Forum's 
Quality Improvement Network are con- 
ducting a functional benchmarking study 
of the admissions process. They chose 
admissions because it presented com- 
plex problems and was important to cus- 
tomers. This rationale reflects IBC's crite- 
ria for selecting a process for bench- 
marking: The process selected should 
be of strategic importance, a competitive 
area, a critical success factor, a problem 
area, or otherwise significant in terms of 
quality, cost, or cycle time. Admissions 
was selected also because it is a proc- 
ess found not only in all hospitals, but in 
slightly different forms in other industries 
and fields as well (school registration, for 
example). The Healthcare Forum/IBC 
group is examining a hotel, a car rental 
company, and an airline with superior 
check-in or registration procedures. 

A process improvement team at Craw- 
ford-Long Hospital (Emory University, At- 
lanta) decided to benchmark the hospi- 
tal's admissions, discharge, and transfer 
systems. The team chose admissions 
because the extent of the problems in 
that area dictated the need for funda- 
mental changes, not just incremental im- 
provements. The benchmarking team 
wanted improvement over current per- 
formance, but didn't want "stopgap 
measures." They wanted to have the 
best practice. 

They brainstormed, made detailed 
flow charts of their admissions process, 
drew cause-and-effect diagrams, and 
compiled lists of problems. They found 
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that patients were being held in the 
emergency department too long, and 
physicians couldn't get their patients ad- 
mitted. As a result, physicians and staff 
circumvented the system. 

The team collected data on numerous 
quantitative and qualitative indicators, 
which formed the basis for a two-page 
questionnaire. 

Sample indicators: 

• Percent of patient placements in the 
previous month that were inappropri- 
ate 

• Average length of time (in minutes) to 
accomplish an in-house transfer 

• Average time (in minutes) it takes for 
patients to leave after discharge order 
is written 

The team identified 28 hospitals to 
survey, some chosen simply by word of 
mouth, by people's experiences with 
them; others chosen because of their 
professional affiliation with Crawford- 
Long Hospital. The analysis of the sur- 
vey results included a matrix ranking the 
strong and weak points for each hospi- 
tal, and rankings that pinpointed the hos- 
pitals to benchmark. The analysis in- 
cluded hospital type and demographics. 
The group identified three best-in-class 
hospitals in the areas of admissions, dis- 
charge, and transfer. The team asked 
each hospital for permission to interview 
staff from admissions, information sys- 
tems, nursing, housekeeping, and mar- 
keting. 

The Crawford-Long team uncovered 
many attributes that contributed to supe- 
rior admissions, discharge, and transfer 
systems in the benchmark hospitals. Re- 
porting its findings, the benchmarking 
team made three levels of recommenda- 
tions: things that can be implemented im- 
mediately, those that could be imple- 
mented later, and those that they might 
be able to implement "down the road." 

Only nine months elapsed between 
the inception of the benchmark commit- 
tee and the implementation of the first 
process improvements. They had defi- 
nite target dates for every step of the 
process. 



Improving th* Quality of Emergency 
Sen/ices. When 15 members of Sun- 
Health Alliance, a voluntary affiliation of 
240 hospitals and other healthcare or- 
ganizations in the southern US, con- 
ducted two pilot benchmarking studies, 
they discovered that each hospital con- 
tributed, and learned, certain superior 
practices or techniques. The key to that 
result was choosing a process that is cru- 
cial to all participants. They selected 
emergency services and admissions be- 
cause they are the first point of contact 
for many patients and physicians and, 
as such, are critical to the hospital from 
the customer's perspective. 

The team studying emergency serv- 
ices, consisting of representatives from 
nine hospitals ranging in size from 250 
to 750 beds, examined patient flow. 
They decided that the time it took a pa- 
tient to go through the Emergency Serv- 
ices department was the critical metric. 
The team identified six key steps in the 
patient's movement through the depart- 
ment: 

• Patient arrives 

• First contact with staff 

• Triage (initial determination of pa- 
tient's need) 

• Registration 

• Patient enters treatment room 

• Physician begins treatment 

A'ter measuring the average amount 
of tim > it took for patients to proceed 
from one step to another, the benchmark- 
ing team focused on performance differ- 
ences and analyzed what caused the dif- 
ferences. Some of the key items they 
found that determined more efficient and 
effective performance were: 

• Strong triage systems in which staff 
with a variety of skills work together to 
determine patient's priority of need 
and place of treatment 

• Standardized nursing protocols in tri- 
age that allow nurses to order certain 
diagnostic tests before the physician 
sees the patient 

• The presence of ancillary services 
near or within the emergency depart- 



ment, including dedicated x-ray tech- 
nicians and equipment 

• Patient tracking systems that allow 
staff to pinpoint the status of a patient 
and his or her chart at any time 

• A mobile registration system that al- 
lows patients to register wherever 
they are in the emergency department 

Improving Health Care Itself Through 
Benchmarking. Benchmarking does not 
have to be limited to the improvement of 
administrative and support processes. In 
fact, some believe that the ultimate test 
of benchmarking's utility in healthcare 
will be in the arena of clinical proc- 
esses — the actual delivery of medical 
care. At Sutter Health, a 12-hospitaI inte- 
grated healthcare system in Sacra- 
mento, California, physicians and man- 
agers have begun the formidable task of 
clinical benchmarking. Sutter Memorial 
Hospital has teamed up with three simi- 
lar but noncompeting hospitals in Los An- 
geles, Portland, Oregon, and Seattle to 
benchmark their procedures for coronary 
artery bypass grafts and coronary 
angioplasty. The goal is more cost-effec- 
tive, demonstrably high-quality care. The 
group selected cardiac care because the 
hospitals in the group have a high vol- 
ume of these patients, and because it is 
an area of high risk and great variation. 

Other hospitals and healthcare 
groups are planning similar efforts. Sun- 
Health will soon be conducting four or 
five benchmarking projects focusing on 
circulatory disorders. Member hospitals 
have also expressed interest in bench- 
marking procedures for orthopedic sur- 
gery, treatment for cardiovascular acci- 
dents and stroke, and pneumonia. 

Insurers and health maintenance or- 
ganizations (HMOs) have begun to join 
in benchmarking efforts with hospitals. 
The National Committee for Quality As- 
surance and 30 major HMO ; and insur- 
ers are developing a common set of 
benchmark indicators and standards. Un- 
der consideration are breast and cervical 
cancer screening tests, prenatal care, 
and frequency of hospitalization for chil- 
dren with asthma, a potential indicator of 
the quality of primary care. 
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The Maryland Quality Indicator Pro- 
ject (600 hospital participants in 46 
states) is a national effort to track the 
quality of the delivery of medical care. 
The participants are trying to find a way 
for hospitals to measure objectively the 
quality of the clinical care that they pro- 
vide. Although many hospitals already 
collect the kind of data that are re- 
quested, participation in the Maryland 
project allows for benchmarking of an in- 
dividual hospital's performance with oth- 
ers. 'The combined focus on outcomes 
and process allows the provider to look 
at both ends of the spectrum — what care 
is delivered and how it's delivered," says 
Sandy Metzler, of the American Hospital 
Association, Chicago (Sabatino, 1992). 

Benchmarking is critical for the suc- 
cess of this project. In the absence of 
normative data, hospitals must rely on 
the phrase, "we're unique" to explain 
findings like a high mortality rate. It's 
hard to embrace any process to improve 
care without baseline information on 
what needs to be improved, and bench- 
marking provides that data. The follow- 
ing is a sampling of the kind of indicators 
on which the project is building baseline 
data: 

• Hospital-acquired infections 

• Surgical-wound infections 

• Inpatient mortality 

• Neonatal mortality 

• Caesarean sections 

• Unplanned readmissions 

• Unplanned returns to the operating 
room 

• Patients in the emergency room more 
than six hours 

• Discrepancies between initial and fi- 
nal X-ray reports requiring an adjust- 
ment in patient management 

CONCLUSION 

Streamlining production at IBM, boost- 
ing the efficiency of warehousing opera- 
tions at Xerox, cutting overtime in a hos- 
pital admissions department, and improv- 
ing the clinical treatment of patients— 
these very different success stories have 



resulted from benchmarking. But just as 
there is no "one right way" to order sup- 
plies, register students, or conduct a 
classroom session, there is no one right 
way to benchmark. In fact, each health- 
care organization approaches bench- 
marking a little differently as it applies 
the technique to administrative, clinical 
support, and patient care processes. 
Educators can look at how these health- 
care organizations benchmarked, and 
adapt the process to their own needs in 
their schools and school systems. 

Benchmarking is not a mechanical 
process; it is "a skill, an attitude, and a 
practice that ensures the organization al- 
ways has its sights set on excellence, 
not merely on improvement" (Walleck, 
O'Halloran, & Leader, 1991, p.13). 
Through participation in benchmarking, 
line managers can be brought face-to- 
face with superior practices. Instead of 
being exhorted to do better, they can 
see for themselves how much better 
something can be done. If hospitals can 
learn from airlines, hotels, and other hos- 
pitals, schools can learn from busi- 
nesses and other schools, too. 

Benchmarking is not a short cut to 
quality and success. It is hard work. But 
it is not extra work; it becomes the way 
an organization does its work. The con- 
tinuous focus on excellence transforms 
an organization's culture and stimulates 
creativity; this is the feature that gives 
benchmarking such power. 

— Morton Inger 
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